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® Adaptive interframe prediction coded video communications system. 



@ At the transmit end of a video communications 
system, a first motion vector is derived from succes- 
sive frames during a frame transmit mode and a 
second motion vector is derived during or imme- 
diately following a frame discard mode. An inter- 
frame predicted error signal is generated which is 
representative of the difference between each input 
frame and a motion-compensated, previous frame 
during the frame transmit mode, the difference being 
zero during the frame discard mode. The predicted 
error signal and the vectors are transmitted to the 
receive end of the system. In a first embodiment the 
second motion vector is derived at the transmit end 
from frames spaced apart by a discarded frame, and 
at the receive end, original frames are recovered 



from the predicted error signal as well as from the 
first and second motion vectors, and the second 
motion vector is down-scaled and evaluated whether 
it is valid or not During frame discard mode, motion 
compensation is performed on the recovered frame 
using the down-scaled vector in response to a valid 
evaluation, but no compensation is performed if in- 
valid evaluation is made. In a second embodiment, 
the second motion vector is derived at the transmit 
end from successive frames using a larger block 
size than that used in the first motion vector. At the 
receive end, the first motion vector as well as the 
error signal are used in recovering original frames. 
During the frame discard mode, the second vector is 
simply used for motion compensation. 
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The present invention relates generally to video 
communications system, and more specifically to a 
video communications system in which motion- 
compensated interframe prediction coding and de- 
coding principles are employed to reduce the rate 5 
of transmitted signals. 

In a video communications system, a technique 
known as interframe predicting coding at the trans- 
mit end is employed to discard frames in order to 
set an upper limit on the transmission bit rate w 
which would otherwise exceed that limit as a result 
of rapidly moving images. At the receive end of the 
system, discarded frames are created by repeat- 
edly displaying a previous frame. The shortcoming 
of this technique is that jerkiness arises due to the is 
repetition of same frames. 

An interpolation technique is described in 
-Motion-Adaptive Interpolation For vldeoconference 
Pictures''. A. Furukawa et al., ICC *84, Links for The 
Future, Science, Systems & Services for Cornmu- 20 
nications, IEEE International Conference on Com- 
munications, May 14-17, 1984 RAI Congress Cen- 
tre, Amsterdam, The Netherlands, Proceedings, 
Volume 2, pages 707 to 710. According to this 
technique, an interframe predicted error signal and 25 
a motion vector are transmitted to a receive end 
where a representative vector is derived from the 
transmitted vectors and used for motion-compen- 
sating for a repeated frame to eliminate jerkiness. 

It is therefore an object of the present invention 30 
to provide interframe prediction coding and decod- 
ing technique for video communications that is less 
liable to jerkiness. 

At the transmit end of a video communications 
system of the present invention, a first motion 35 
vector is derived from successive frames during a 
frame transmit mode and a second motion vector 
is derived during or immediately following a frame 
discard mode. An interframe predicted error signal 
is generated which is representative of the drf- aq 
ference between each input frame and a motion- 
compensated, previous frame during the frame 
transmit mode, the difference being zero during the 
frame discard mode. The predicted error signal 
and the vectors are transmitted to the receive end as 
of the system. 

According to a first aspect of this invention, the 
second motion vector is derived at the transmit end 
from frames spaced apart by a discarded frame, 
and at the receive end, original frames are recov- 50 
ered from the predicted error signal as well as from 
the first and second motion vectors, and the sec- 
ond motion vector is down-scaled arid evaluated 
whether it is valid or not During frame discard 
mode, motion compensation is performed on the 55 
recovered frame using the down-scaJed vector in 
response to a valid evaluation, but no compensa- 
tion is performed if invalid evaluation is made. 



According to a second aspect, the second mo- 
tion vector is derived at the transmit end from 
successive frames using a larger block size than 
that used in the first motion vector. At the receive 
end, the first motion vector as well as the error 
signal are used in recovering original frames. Dur- 
ing the frame discard mode, the second vector is 
simply used for motion compensation. 

More specifically, the first aspect of the present 
invention provides a digital video communications 
system operating in a frame transit mode or a 
frame discard mode depending on a rate of signals 
being transmitted. The system includes a motion 
vector detector operable during the frame transmit 
mode for deriving a first motion vector from a 
current input frame and a previous frame and a 
second motion vector from frames spaced apart by 
an intermediate frame which was discarded during 
the frame discard mode. A coding circuit locally 
recovers a previous input frame during the frame 
transmit mode, repeats the recovered frame during 
the frame discard mode, motion-compensates for 
the locally recovered frame with both first and 
second motion vectors, arid generates an inter- 
frame predicted error signal containing an initial 
frame followed by a differential signal which is 
representative of the difference between the cur- 
rent input frame and the motion-compensated 
frame during the frame transmit mode and is repre- 
sentative of a zero difference during the frame 
discard mode. The predicted error signal and the 
first and second motion vectors are transmitted 
through a transmission medium and received at the 
receive end of the system, where original frames 
are recovered from the received predicted error 
signal as well as from both first and second motion 
vectors, and the received second motion vector is 
down-scaled. A decision circuit is provided for 
making a first or second decision if the received 
second motion vector is valid or invalid, respec- 
tively, for motion compensation to be effected dur- 
ing the frame discard mode. A variable delay cir- 
cuit is coupled to the decoding circuit to introduce 
no delays to frames recovered by the decoding 
circuit during the frame transmit mode, and is 
responsive to the first decision to introduce a delay 
corresponding to the down-scaled motion vector to 
a frame recovered during the frame discard mode. 
In response to the second decision, the variable 
delay circuit introduces no delay to the frame re- 
covered during the frame discard mode. 

According to the second aspect, a first motion 
vector detector is provided for performing block 
matching between successive input frames with a 
smaller block size during the frame transmit mode 
to produce a first motion vector, and a second 
motion vector detector is provided for performing 
block matching between successive input frames 
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with a larger block size during the frame discard 
mode and producing a second motion vector. A 
coding circuit locally recovers a previous input 
frame during the frame transmit mode, repeats the 
recovered frame during the frame discard mode, 
motion-compensates for the locally recovered 
frame with the first motion vector, and generates an 
interframe predicted error signal containing an ini- 
tial frame followed by a differential signal which is 
representative of the difference between the cur- 
rent input frame and the motion-compensated 
frame during the frame transmit mode and is repre- 
sentative of a zero difference during the frame 
discard mode. At the receive end, original frames 
are recovered from the received predicted error 
signal as well as from the received first motion 
vector. A variable delay circuit is coupled to the 
decoding circuit to introduce no delays to frames 
recovered during the frame transmit mode and 
introduce a delay corresponding to the received 
second motion vector to a frame recovered during 
the frame discard mode! 

The present invention will be described in fur- 
ther detail with reference to the accompanying 
drawings, in which: 

Fig. 1 is a block diagram of an interframe 
prediction coder according to an embodiment of 
the present invention; 

Fig. 2 is a block diagram of an interframe 
prediction decoder associated with the prediction 
coder of Fig. 1; 

Figs. 3 and 4 are timing diagrams associated 
respectively with the coder and decoder of figs. 1 
and 2; 

Fig. 5 is a block diagram of an interframe 
prediction coder according to a modified embodi- 
ment of the present invention; 

Fig. 6 is a block diagram of an interframe 
prediction decoder associated with the prediction 
coder of Fig. 4; and 

. Figs. 7 and 8 are timing diagrams associated 
respectively with the coder and decoder of figs. 5 
and 6. 

Referring now to Fig. 1, there is shown a 
motion-compensated adaptive interframe prediction 
coder according to an embodiment of the present 
invention. Digitized (PCM) video signal appearing 
at input terminal 10 is passed through a spatial 
lowpass filter 11 to a motion vector detector 12, 
and further applied through a delay circuit 13 to a 
first input of a subtracter 14 which forms part of an 
interframe prediction coding bop. The output of 
subtractor 14 is quantised by a quantizer 15 and 
fed to one input of an adder 16 as well as to a 
variable length encoder 20. The output of adder 16 
is delayed for a frame interval by a one-frame 
memory, or delay circuit 17 and fed to a variable 
delay circuit 18 whose delay time is controlled by 



the output of motion vector detector 12. The output 
of variable delay circuit 18 is passed through a 
delay circuit 19 to a second input of subtractor 14 
where it is subtracted from the output of delay 
s circuit 13, and further applied to the second input 
of adder 16. The amounts of delay circuits 13 and 
19 are appropriately adjusted so that the current 
frame appearing at the first input of subtractor 14 is 
coincident with a previous frame appearing at the 
w second input. 

Motion vector detector 12 is of a known design 
which receives the output of frame delay circuit 1 7 
as its second input signal to detect a motion vector 
V on a block-by-block basis in a manner known as 
75 "block matching method." Namely, a block of pixel 
intensities in a given frame is matched to a block in 
a subsequent frame by searching for the displace- 
ment, or "motion vector" which produces the "best 
match" in which the sum of absolute values of 
20 interframe differences is at a minimum. 

A controller 21 provides control on the quan- 
tizer 15 in accordance with the storage level of a 
transmit buffer 23. When the amount of data stored 
in buffer 23 is lower than a prescribed storage 
25 level, controller 21 produces a logic-1 signal which 
enables the quantizer 15 to quantize its input signal 
into quantization levels appropriate for transmis- 
sion. If it exceeds the prescribed level, controller 
21 produces a logic-0 signal to hold the output of 
30 quantizer 15 to a logic-0 level for discarding a 
frame to prevent buffer 23 from being overloaded. 
Motion vector detector 12 effects the motion vector 
.detection when the output of controller 21 is at 
logic 1 and is disabled when it is at logic 0, 
35 producing a zero vector output Spatial lowpass 
filter 11 has the effect of allowing motion vector 
detector 12 to produce precise motion vectors. 

A time division multiplexer 22 combines the 
outputs of variable length encoder 20, motion vec- 
40 tor detector 12 and controller 21 into a single data 
bit stream for coupling to transmit buffer 23 whose 
output is coupled through a line interface 24 to a 
transmission line 25. 

'. The operation of the coding circuit of Fig. 1 is 
45 visualized with reference to Fig. 3. Assume that 
transmit buffer 23 is initially cleared and its storage 
level is lower than the prescribed value during 
frame periods other than #4 and #7. Controller 21 
produces a logic-1 output during these frame 
so periods. 

When #1 -frame digital video signal is fed to the 
first input of motion vector detector 12 through 
input terminal 10, there is no video signal at the 
second input of motion vector 12 from one-frame 
55 delay circuit 17 and therefore it produces no vector 
output. Therefore, during #1 frame period, ho video 
signal appears at the output of variable delay cir- 
cuit 18 and the frame #1 appears at the output of 
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subtracter 14 as well as at the output of adder 16. 
During #2 frame period, frame #1 reappears at the 
output of one-frame delay circuit 17 and a frame #2 
appears at the input terminal 10. Motion vector 
detector 12 produces a motion vector V2 by per- 
forming a block matching between the incoming #2 
frame and the previous frame #1. In accordance 
with the motion vector V2, variable delay circuit 18 
introduces a delay time to the #1 -frame video sig- 
nal, producing a motion-compensated video signal 
#1(V2) as indicated in Fig. 3. As a result a dif- 
ference signal of magnitude #2-#1(V2) is encoded 
by quantizer 15 for transmission, and a locally 
recovered frame #2 is generated at the output of 
adder 16 to be used during #3 frame period. Simi- 
lar operations continue as long as the storage level 
of buffer 23 is lower than the prescribed value, so 
that during #3 frame period, a difference signal of 
magnitude #3-#2(V3) is encoded for transmission 
and a replica of frame #3 is locally recovered at the 
output of adder 16 to be used during the next 
frame period. 

When buffer 23 reaches its prescribed storage 
level during #4 frame period, controller 21 switches 
its output to a logic-0 level to discard frame #4. In 
response; to this logic-0 output, motion vector de- 
tector 12 generates a 0 vector output and quantizer 
15 produces a logic-0 output Variable delay circuit 
18 allows frame #3 to pass therethrough with no 
delays to subtracter 14 as well as to adder 16. 
Therefore, frame #3 will appear again at the output 
of one-frame delay circuit 17 during #5 frame pe- 
riod. In this way, motion-compensated difference 
video signals {interframe predicted errors) are gen- 
erated when frarnes are not discarded and no sig- 
nals are transmitted when frames are discarded. It 
is seen from Fig. 3 that each of motion vectors V2. 
V3, V6, V9 and V10 is derived from consecutive 
frames, whereas motion vectors V5 and V8 are 
each derived from two frames spaced apart by an 
intermediate frame which was discarded. The out- 
put of variable length encoder 20 represents an 
interframe predicted error and the output of control- 
ler 21 represents a frame mode signal which at one 
of two logic levels as described above. These 
signals are multiplexed with the motion vector sig- 
nal into a single data bit stream for transmission. 

In Fig. 2. there is shown a motion-compensated 
prediction decoder according to the first embodi- 
ment of the present invention. The decoder com- 
prises a line interface unit 30 interfacing the de- 
coder to transmission line 25. Signals transmitted 
from the prediction coder are temporarily stored 
into a receive buffer 31 before being fed to a time- 
division demultiplexer 32 where the incoming data 
bit stream is decomposed into the predicted error 
signal for coupling to a variable length decoder 33, 
the motion vector signal for coupling to a divide-by- 



2 circuit 40 and the frame mode signal for coupling 
to a one-frame delay circuit 47 to the output of 
which another one-frame delay circuit 48 is con- 
nected. The series connection of delay circuits 47 
5 and 48 produces a logic 0 at the negative input of 
an AND gate 46 at time which is delayed by two 
frame periods following the occurrence of a frame 
which was discarded. 

The output of decoder 33 is fed to one input of 
;o an adder 34 the output of which is coupled to a 
one-frame delay circuit 35. A variable delay circuit 
36 is connected to the output of delay 35 to form a 
frame recovery loop by coupling to the second 
input of adder 34 a version of a frame which is 

is motion-compensated for with the horizontal and 
vertical (X-Y) components of a demultiplexed mo- 
tion vector. The output of one-frame delay 35 is fed 
to another one-frame delay circuit 37 and thence to 
a variable delay circuit 36 which is responsive to 

20 the output of a switch 42. 

Divide-by-2 circuit 40 halves the horizontal and 
vertical components of motion vector in response 
to a logic-0 output from delay circuit 47 and sup- 
plies an output vector to a one-frame delay circuit 

25 41 which is in turn coupled to switch 42. 

The output of decoder 33 is further applied to 
an absolute sum calculator 43. This calculator is 
enabled in response to the logic-0 output of one- 
frarhe delay 47 to provide a sum of the absolute 

30 values of the predicted errors of the frame period 
that immediately follows a discarded frame on a 
block-by-block basis. The output of calculator 43 is 
stored for a frame duration in a delay circuit 44. A 
threshold decision circuit 45 is connected to the 

35 output of delay 44 to determine whether a motion 
vector which was received on a previous frame has 
an acceptable level of precision. This determination 
is made in response to the togic-0 output of delay 
48 by comparing the calculated sum with a pre- 

40 scribed decision threshold and supplies a logic 0 to 
one input of AND gate 46 when the sum is higher 
than the decision threshold or a logic 1 when the 
sum exceeds the decision threshold. The logic-0 
output of threshold decision circuit 45 indicates that 

45 the motion vector is not sufficiently precise to be 
used by variable delay 38 to provide motion-com- 
pensation. Therefore, under such conditions, the 
motion vector is not used, and a previous frame is 
simply repeated. The togic-1 output of the decision 

so circuit, on the other hand, indicates that the motion 
vector is sufficiently precise for such purposes and 
is supplied to variable delay 38 via switch 42 
following a one-frame delay period to motion-com- 
pensate for a frame which was repeated as an 

55 interpolation of a discarded frame. . 

The output of AND gate 46 is used to control 
the switch 42. In the presence of a togic-0 input 
from AND gate 46, switch 42 applies a logic 0 to 
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variable delay circuit 38 to allow it to pass the 
output of one-frame delay 37 without delays to an 
output terminal 39. In response to a logic 1 from 
AND gate 46, switch 42 couples the one-frame 
delayed output of divide-by-2 circuit 40 to variable 
delay 38 to cause it to motion-compensate for the 
output of delay 37. This is accomplished by delay- 
ing the input from delay circuit 37 by an amount 
corresponding to one-halves of the horizontal and 
vertical components of a motion vector such as V5 
and V8 which was derived from two frames be- 
tween which the intermediate frame was discarded. 

The operation of the decoder of Fig. 2 is best 
understood with reference to Rg. 4. During the first 
frame period, the #1 -frame video signal is recov- 
ered by decoder 33 and is passed through adder 
34 to delay circuit 35. 

During the second frame period, the frame #1 
is entered to delay 37 and the next frame, which is 
the predicted error represented by #2 -#1(V2), is 
supplied to adder 34. Motion vector V2 is also 
applied to the control input of variable delay circuit 
36 to motion-compensate for the #1rframe video 
signal appearing at the output of delay 35 by 
delaying it by an amount corresponding to the X-Y 
components of that vector. The output of variable 
delay 36 is therefore represented by #1(V2) and 
summed by adder 34 with the current interframe 
predicted error which is given by #2 - #1(V2), thus 
recovering a replica of the original frame #2 at the 
input of delay 35. 

During the third frame period, the frame #1 
now stored in delay 37 is emptied to variable delay 
38. Since the output of AND gate 46 is at logic 0, 
frame #1 is allowed to appear at the output termi- 
nal 39 without delays. The frame #2 now stored in 
delay 35 is entered to variable delay 36 where it is 
compensated for with the current motion vector V3 
and summed by adder 34 with the current pre- 
dicted error #3-#2(V3), recovering a replica of the 
original frame #3 at the input of delay 35. 

In a similar manner, frames #2 and #3 appear 
at the output terminal 39 in succession during the 
fourth and fifth frame periods, respectively. Since 
frame #4 was discarded, and hence the predicted 
error and motion vector are both 0 during the fourth 
frame period, frame #3 appears again at the output 
of adder 34! 

Assume that the motion vector V5 that is sent 
during the fifth frame period has an acceptable 
level of precision for motion compensation while 
motion vector V8 which will be sent during the 
seventh frame period is below the acceptable level. 
Absolute sum calculator 43 responds to a logic-0 
output from delay 47 during the fifth frame period 
to generate an output of amplitude which is below 
the decision threshold as indicated by a dashed 
line in Rg. 4. 



During the sixth frame period, the output of 
calculator 43 appears at the input of threshold 
decision circuit 45 after passing through delay cir- 
cuit 44. In response to a logic-0 output from delay 
48, decision circuit 45 compares the absolute sum 
with the decision threshold and produces a logic-1 
output as indicated in Fig. 4. It is seen that AND 
gate 46 now produces a logic-1 output at the 
control input of switch 42 to switch its output to the 
lower position. The horizontal and vertical compo- 
nents of motion vector V5 were halved during #5 
frame period and stored in delay 41. This halved 
motion vector, represented by V5/2, is now sup- 
plied through switch 42 to the control input of 
variable delay 38 to compensate for the output of 
delay 37 which corresponds to frame #3 of the 
second occurrence, recovering a video output re- 
presented by #3(V5/2) which appears at the output 
terminal 39 as a result of "motion- compensated 
interpolation." 

During the seventh frame period, since frame 
#7 was discarded, frame #6 appears again at the 
output of adder 34 and stored in one-frame delay 
35. Frame #5 is now supplied from delay 37 and 
passed through variable delay 38 without delays to 
the output terminal 39 since the output of AND 
gate 46 is now at logic 0. 

During the eighth frame period, a logic-0 output 
appears at the output delay 47 enabling the cal- 
culator 43 and divide-by-2 circuit 40 to carry out 
their functions, so that a vector V8/2 is stored into 
one-frame delay 41 to be used in the next frame 
period. Since the motion vector V7 is assumed to 
be of inacceptable quality, calculator 43 produces 
an output that exceeds the decision threshold. 
Frame #6 stored in delay 37 now appears at the 
output terminal 39. 

During the ninth frame period, decision circuit 
45 generates a logic 0 which disables AND gate 
46. Thus, the output of AND gate 46 remains at 
logic 0. and switch 42 continues to supply logic 0 
to the control input of variable delay 38 through 
which frame #6 is passed without delays and ap- 
pears at the output terminal 39 as a result of 
"linear interpolation." The repeated appearance of 
frame #6 before the recovery of frame #8 during 
the next frame may produce some jerkiness, but it 
improves the total quality of reconstructed images 
by preventing the display of frame #6 which would 
otherwise be deteriorated by the inacceptable mo- 
tion vector V7. 

An interframe prediction coder and decoder of 
a modified embodiment of the present invention 
are shown in Figs. 5 and 6, respectively, in which 
parts corresponding to those in Rgs. 1 and 2 are 
marked with the same but primed numerals, the 
description of these corresponding parts being 
omitted for conciseness. 
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In Fig. 5 t the modified prediction coder differs 
from the previous embodiment in that it includes 
two motion vector detectors 50 and 51 and switch- 
es 52 and 53. Motion vector detector 50 provides 
block matching using a smaller block size when 
frames are encoded for transmission, while motion 
vector detector 51 provides block matching with a 
larger block size when a frame is discarded. The 
use of smaller block size has the effect of produc- 
ing vectors which limit the power level of predicted 
errors to a suitable level which would otherwise be 
exceeded, while the use of larger block size has 
the effect of generating more accurate vectors dur- 
ing frame discard modes than those produced with 
the use of smaller block size to permit the predic- 
tion decoder to perform precise motion-compen- 
sated interpolation. 

The outputs of motion vector detectors 50 and 
51 are selectively coupled by switch 52 to mul- 
tiplexer 22 for transmission in response to the 
output of controller 21 '. Switch 53 is also respon- 
sive to the controller output to selectively apply the 
output of detector 50 and ground potential (or logic 
0) to the control terminal of variable delay circuit 
18*. When the output of controller 2l' is at logic 1, 
switch 52 is in the upper position and switch 53 is 
in the left position, coupling the output of motion 
vector detector 50 to variable delay 18' as well as 
to multiplexer 22 . When the controller output is at 
logic 0, switch 52 is in the lower position to apply 
the output of detector 51 to multiplexer 22' and 
switch 53 is in the right position to supply a logic 0 
to variable delay 18'. 

A timing diagram of the coder of Fig. 5 is 
shown in Fig. 7. During the first to third frame 
periods, the output of controller 21 ' is at logic 1 so 
that switches 52 and 53 are in the upper and left 
positions, respectively. Motion vectors 0, V2 and 
V3 are successively generated by vector detector 

50 for transmission to the prediction decoder of 
Fig. 6 and variable delay 18' is controlled with such 
vectors to produce a frame #1 followed by pre- 
dicted errors #2-^1 (V2) and #3-#2(V3) at the output 
of quantizer 15*. . Events similar to those of the 
second and third frame periods occur during other 
frame transmit modes, i.e., the fifth, sixth, eighth, 
ninth and tenth frame periods. 

During the fourth frame period in which frame 
#4 is discarded, the controller output is at logic 0, 
operating the switches 52 and 53 to the lower and 
right positions, respectively. Motion vector detector 

51 performs block matching between the frame #3 
supplied from delay 17' and the current frame #4 
using a larger block size to produce a vector \74*, 
which is fed to the multiplexer 22' and transmitted. 
Variable delay 18' is supplied with a logic-0 (zero- 
delay) control input to produce a zero predicted 
error output for transmission. Similar events occur 



during the seventh frame period in which motion 
vector Wis derived from frames #6 and #7 and 
transmitted. 

It is seen from Fig. 7 that the operation of the 
5 modified prediction coder differs from the previous 
embodiment in that vectors derived with the use of 
the larger block size are transmitted instead of the 
zero vectors of the Fig. 1 embodiment 

In the modified prediction decoder of Fig. 6, 
70 the demultiplexed vector is applied to the left posi- 
tion of a switch 60 on the one hand and applied 
further via a one-frame delay circuit 61 to the left 
position of a switch 62 on the other. The right 
positions of switches 60 and 62 are grounded to 
75 supply a logic 0 and their output terminals are 
respectively coupled to variable delay circuits 36' 
and 64. The demultiplexed frame mode signal is 
used as a switching control signal and applied 
direct to switch 60 and via a one-frame delay 

20 circuit 63 to switch 62. At logic 1, the frame mode 
signal causes switch 60 to move to the left position 
to operate the variable delay circuit 36* with a 
received vector and causes switch 62. after a 
frame-period delay, to rnove to the right position to 

25 supply a logic 0 to a variable delay circuit 39' 
which is connected to the output of delay 35'. tn 
response to the logic 0. the output of delay 35' is 
passed through variable delay 38 without delays to 
output terminal 39 . When the frame mode signal is 

30 at logic 0, switch 60 is moved to the right position 
to allow the output of delay 35' to be passed 
through variable delay 36' to adder 34' without 
delays. Concurrently, switch 62 is moved to the 
right position to couple the output of one-frame 

35 delay 61 to variable delay 38 to cause it to per- 
form motion-compensation on the output of delay 
35' using a vector that is received during frame 
discard mode. 

The operation of the decoder of Fig. 6 will be 

40 understood with reference to Rg. 8. During the first 
to third frame periods (frame transmit modes), mo- 
tion vectors 0, V2 and V3 are received succes- 
sively and one-frame delayed versions of frame #1 
and following predicted errors are successively 

45 motion-compensated for with the vectors and 
summed with later incoming signals by the frame 
recovery loop consisting of adder 34', one-frame 
delay 35' and variable delay 36', so that during the 
first and second frame periods frames #1 and #2 

50 are recovered at the output of variable delay 38' 
which is now operating with a zero-delay control 
input from switch 62. 

During the fourth frame period (frame discard 
mode), the predicted error is zero and is summed 

ss with a delayed version of frame #3 appearing at the 
output of delay 36' which is now operating with a 
zero-delay control input from switch 60, thus re- 
covering frame #3 at the output of delay 38' which 
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is still operating with the zero-delay control input 
from switch 62. Frame #3 is stored again into delay 
35 # to be motion-compensated in the next frame 
period, and switch 62 is moved to the right so that 
a delayed version of frame #3 is motion-compen- 
sated for with vector V5 by variable delay 36 for 
coupling to adder 34' on the one hand, and is 
further motion-compensated for with a delayed ver- 
sion of vector Wby variable delay 38' generating 
an output #3( W), on the other, for delivery to the 
output terminal 39' as an interpolation of frame #4. 

Events similar to those in the third to fifth 
frame periods occur respectively during the sixth to 
eighth frame periods, recovering frames #5, #6 and 
#6( W) in succession. 

The foregoing description shows only preferred 
embodiments of the present invention. Various 
modifications are apparent to those skilled in the 
art without departing from the scope of the present 
invention which is only limited by the appended 
claims. Therefore, the embodiments shown and 
described are only illustrative, not restrictive. 



Claims 

1 . A digital video communications system op- 
erating in a frame transmit mode or a frame dis- 
card mode depending on a rate of signals being 
transmitted, comprising: 

a motion vector detector operable during said 
frame transmit mode for deriving a first motion 
vector from a current input frame and a previous 
frame and a second motion vector from frames 
spaced apart by an intermediate frame which was 
discarded during said frame discard mode; 
a coding circuit for locally recovering a previous 
input frame during said frame transmit mode, re- 
peating the recovered frame during said frame 
discard mode, motion-compensating for the locally 
recovered frame with said first and second motion 
vectors, and generating an interframe predicted 
error signal containing an initial frame followed by a 
differential signal which is representative of the 
difference between said current input frame and 
said motion-compensated frame during said frame 
transmit mode and is representative of a zero dif- 
ference during said frame discard mode; 
transmit means for transmitting said predicted error 
signal and said first and second motion vectors 
through a transmission medium; 
receive means for receiving said predicted error 
signal and said first and second motion vectors 
through said transmission medium; 
a decoding circuit for recovering original frames 
from the received predicted error signal and the 
received first and second motion vectors; 
variable delay means coupled to said decoding 



circuit; 

means for down-scaling the received second mo- 
tion vector; 

decision means for making a first or second de- 
5 cision H the received second motion vector is valid 
or invalid, respectively, for motion compensation to 
be effected during said frame discard mode; and 
means for causing said variable delay means to 
introduce no delays to frames recovered by said 
70 decoding circut during said frame transmit mode, 
and responsive to said first decision for causing 
said variable delay means to introduce, a delay 
corresponding to the down-scaled motion vector to 
a frame recovered by said decoding circuit during 
75 said frame discard mode and responsive to said 
second decision for causing said variable delay 
means to introduce no delay to the frame recov- 
ered during said frame discard mode. 

2, A digital video communications system as 
20 claimed in claim 1 , wherein said down-scaling 

means halves horizontal and vertical components 
of the received second motion vector. 

3. A digital video communications system as 
claimed in claim 1 or 2, wherein said decision 

26 means makes said first decision if the predicted 
error signal which is received immediately following 
a discarded frame is below said threshold or said 
second decision if said signal is above said thresh- 
old. 

30 4. A digital video communications system as 
claimed in claim 3, wherein said decision means 
calculates absolute values of the predicted error 
signal of a frame period following said discarded 
frame and gives a sum of said absolute values, and 

35 makes said first decision if said sum is below said 
threshold or said second decision if said sum is 
above said threshold. 

5. A digital video communications system as 
claimed in any of claims 1 to 4. further comprising 

40 a spatial lowpass filter for lowpass-filtering said 
current frame before being applied to said motion 
vector detector. 

6. A decoding apparatus for a digital video 
communications system operating in a frame irans- 

45 mit mode or a frame discard mode depending on a 
rate of signals being transmitted, wherein a coding 
apparatus derives a first motion vector from a cur- 
rent input frame and a previous frame and a sec- 
ond motion vector from frames spaced apart by an 

50 intermediate frame which is discarded during said 
frame discard mode, and generates an interframe 
predicted error signal containing an initial frame 
followed by a differential signal which is repre- 
sentative of the difference between the current 

55 frame and a motion-compensated, previous frame 
during said frame transmit mode and is representa- 
tive of zero difference during said frame discard 
mode, wherein said first and second motion vectors 
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and said error signal are transmitted through a 
transmission medium and received by the decod- 
ing apparatus, comprising: 
a decoding circuit for recovering original frames 
from the received predicted error signal and the 
received first and second motion vectors;, 
variable delay means coupled to said decoding 
circuit; 

means for down-scaling the received second mo- 
tion vector; 

decision means for making a first or second de- 
cision if the received second motion vector is valid 
• or invalid, respectively, for motion compensation to 
be effected during said frame discard mode; and 
means for causing said variable delay means to 
introduce no delays to frames recovered by said 
decoding circut during said frame transmit mode, 
and responsive to said first decision for causing 
said variable delay means to introduce a delay 
corresponding to the down-scaled second motion 
vector to a frame recovered by said decoding 
circuit during said frame discard mode and respon- 
sive to said second decision for causing said vari- 
able delay means to introduce no delay to the 
frame recovered during said frame discard mode. 

7. A decoding apparatus as claimed in claim 6, 
wherein said down-scaling means halves horizontal 
and vertical components of the received second 
motion vector. 

8. A decoding apparatus as claimed in claim 6 
or 7, wherein said decision means makes said first 
decision if the predicted error signal which is re- 
ceived immediately following a discarded frame is 
below a prescribed threshold or said second de- 
cision if said signal is above said threshold. 

9. A decoding apparatus as claimed in claim 8 t 
wherein said decision means calculates absolute 
values of the predicted error signal of a frame 
period following said discarded frame and gives a 
sum of said absolute values, and makes said first 
decision if said sum is below said threshold or said 
second decision if said sum is above said thresh- 
old. 

10. A decoding apparatus as claimed in any of 
claims 6 to 9. further comprising a spatial lowpass 
filter for lowpass-filtering said current frames before 
being applied to said motion vector detector. 

11. A digital video communications system op^ 
erating in a frame transmit mode or a frame dis- 
card mode depending on a rate of signals being 
transmitted, comprising: 

a first motion vector detector for providing block 
matching between successive input frames with a 
smaller block size during said frame transmit mode 
and producing a first motion vector; 
a second motion vector detector for providing block 
matching between successive input frames with a 
larger block size during said frame discard mode 



and producing a second motion vector 
a coding circuit for locally recovering a previous 
input frame during said frame transmit mode, re- 
peating the recovered frame during said frame 

5 discard mode, motion-compensating for the locally 
recovered frame with said first motion vector, and 
generating an interframe predicted error signal con- 
taining an initial frame followed by a differential 
signal which is representative of the difference be- 

;o tween said current input frame and said motion- 
compensated frame during said frame transmit 
mode and is representative of a zero difference 
during said frame discard mode; 
transmit means for transmitting said predicted error 

is signal and said first and second motion vectors 
signal through a transmission medium; 
receive means for receiving said predicted error 
signal and said first and second motion vectors 
through said transmission medium; 

20 a decoding circuit for recovering original frames 
from the received predicted error signal and the 
received first motion vector; 
variable delay means coupled to said decoding 
circuit and 

25 means for causing said variable delay means to 
introduce no delays to frames recovered by said 
decoding circuit during said frame transmit mode 
and for causing said variable delay means to intro- 
duce a delay corresponding to the received second 

30 motion vector to a frame recovered by said decod- 
ing circuit during said frame discard mode. 

12. A digital video communications system as 
claimed in claim 11, further comprising a spatial 
lowpass filter for lowpass-filtering said current 

35 frames before being applied to said first and sec- 
ond motion vector detectors. 

13. A coding apparatus for a digital video com- 
munications system operating in a frame transmit 
mode or a frame discard mode depending on a 

40 rate of signals being transmitted, comprising: 

a first motion vector detector for providing block 
matching between successive input frames with a 
smaller block size during said frame transmit mode 
and producing a first motion vector; 

45 a second motion vector detector for providing block 
matching between successive input frames with a 
larger block size during said frame discard mode 
and producing a second motion vector; 
a coding circuit for locally recovering a previous 

so input frame during said frame transmit mode, re- 
peating the recovered frame during said frame 
discard mode, motion-compensating for the locally 
recovered frame with said first motion vector, and 
generating an interframe predicted error signal con- 

55 taining an initial frame followed by a differential 
signal which is representative of the difference be- 
tween said current input frame and said morjon- 
compensated frame during said frame transmit 
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mode and is representative of a zero difference 
during said frame discard mode; and 
transmit means for transmitting said predicted error 
signal and said first and second motion vectors 
through a transmission medium. 

14. A digital video communications system as 
claimed in claim 13, further comprising a spatial 
lowpass filter for lowpass-filtering said current 
frames before being applied to said first and sec- 
ond motion vector detectors. 

15. A method for use in a digital video commu- 
nications system which operates in a frame trans- 
mit mode or a frame discard mode depending on a 
rate of signals being transmitted, comprising the 
steps of: 

a) deriving a first motion vector from a cur- 
rent input frame and a previous frame and a sec- 
ond motion vector from frames spaced apart by an 
intermediate frame which is discarded; 

b) locally recovering a previous input frame 
during said frame transmit mode, repeating the 
recovered frame during said frame discard mode, 
motion-compensating for the locally recovered 
frame with said first and second motion vectors, 
and generating an interframe predicted error signal 
containing an initial frame followed by a differential 
signal which is representative of the difference be- 
tween said current input frame and said motion- 
compensated frame during said frame transmit 
mode and is representative of a zero difference 
during said frame discard mode; 

c) transmitting said predicted error signal 
and said first and second motion vectors through a 
transmission medium; 

d) receiving said predicted error signal and 
said first and second motion vectors through said 
transmission medium; 

e) recovering original frames from the re- 
ceived predicted error signal and the received first 
and second motion vectors; 

f) down-scaling the received second motion 
vector; 

g) making a first or second decision if the 
received second motion vector is valid or invalid, 
respectively, for motion compensation to be effec- 
ted during said frame discard mode; and 

h) introducing a delay corresponding to the 
down-scaled motion vector to the frame which is 
recovered by the step (e) during said frame discard 
mode if said first decision is made by the step (g), 
introducing no delays to the last-mentioned frame if 
said second decision is made, and introducing no 
delays to frames which are recovered by the step 
(e) during said frame transmit mode. 

16. A method as claimed in claim 15, wherein 
the step (g) halves horizontal and vertical compo- 
nents of the received second motion vector. 

17. A method as claimed in claim 15 or 16. 



wherein the step (h) makes said first decision if the 
predicted error signal which is received immedi- 
ately following a discarded frame is below a pre- 
scribed threshold or said second decision If said 

.5 signal is above said threshold. 

18^ A method as claimed in claim 17, wherein 
the step (h) calculates absolute values of the pre- 
dicted error signal of a frame period following said 
discarded frame and gives a sum of said absolute 

io values and compares the sum against said thresh- 
old for making said first decision if said sum is 
below said threshold or making said second de- 
cision if said sum is above said threshold. 

19. A method as claimed in any one of claims 
is 15 to 18, further comprising the step of lowpass- 
filtering said input frames on a spatial domain prior 
to the step (a). 

20. A decoding method for use in the receive 
end of a digital video comrriunications system op- 

20 erating in a frame transmit mode or a frame dis- 
card mode depending on a rate of signals being 
transmitted, wherein the transmit end of the system 
derives a first motion vector from a current input 
frame and a previous frame and a second motion 

25 vector from frames spaced apart by an intermedi- 
ate frame which is discarded during said frame 
discard mode, and generates an interframe pre- 
dicted error signal containing an initial frame fol- 
lowed by a differential signal which is representa- 

30 tive of the difference between the current frame 
and a motion-compensated, previous frame during 
said frame transmit mode and is representative of 
zero difference during said frame discard mode, 
wherein said first and second motion vectors and 

35 said error signal are transmitted through a trans- 
mission medium and received by the receive end, 
wherein said first and second motion vectors and 
said error signal are transmitted through a trans- 
mission medium and received by said receive end, 

40 comprising the steps of: 

a) recovering original frames from the re- 
ceived interframe predicted error signal and the 
received first and second motion vectors; 

b) down-scaling the received second motion 

45 vector; 

c) making a first or second decision if the 
received second motion vector is valid of invalid, 
respectively, for motion compensation to be effec- 
ted during said frame discard mode; and 

so d) introducing a delay corresponding to the 

down-scaled motion vector to a frame which is 
recovered by the step (a) during said frame discard 
mode if said first decision is made by the step (c), 
introducing no delays to the lastrmentioned frame if 

55 said second decision is made, and introducing no 
delays to a frame which is recovered by the step 
(a) during said frame transmit mode. 

21. A decoding method as claimed in claim 20, 
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wherein the step (b) halves horizontal and vertical 
components of the received second motion vector. 

22. A decoding method as claimed in claim 20 
or 21 f wherein the step (c) makes said first de- 
cision if the predicted error signal which is received 5 
immediately following a discarded frame is below a 
prescribed threshold and makes said second de- 
cision if said signal is above said threshold. 

23. A decoding method as claimed in claim 22, 
wherein the step (c) calculates absolute values of io 
the predicted error signal of a frame period follow- 
ing said discarded frame and gives a sum of said 
absolute values, and wherein said first decision is 
made if said sum is below said threshold and said 
second decision is made if said sum is above said 75 
threshold. 

24. A coding and decoding method for use in a 
video communications system operating in a frame 
transmit mode or a frame discard mode depending 

on a rate of signals being transmitted, comprising 20 
the steps of: 

a) providing block matching between suc- 
cessive input frames with a smaller block size 
during said frame transmit mode and producing a 

first motion vector, and providing block matching 25 
between successive input frames with a larger 
block size during said frame discard mode and 
producing a second motion vector; 

b) delaying said input frames for one frame 
period, providing motion compensation on the de- 30 
layed frame with said first motion vector and pro- 
ducing an interframe predicted error signal contain- 
ing an initial frame followed by a differential signal 
which is representative of a difference between 
each of said input frames and the motion-corn- 35 
pensated frame during said frame transmit mode 

and is zero during said frame discard mode; 

c) transmitting said predicted error signal 
and said first and second motion vectors through a 
transmission medium; 40 

d) receiving said predicted error signal and 
said first and second motion vectors through said 
transmission medium; 

e) recovering original frames from the re- 
ceived predicted error signal and the received first 45 
motion vector; and 

f) introducing no delays to frames recovered 
by the step (f) during said frame transmit mode 
and introducing a delay corresponding to the re- 
ceived second motion vector to a frame recovered so 
by the step (f) during said frame discard mode. 

25. A method as claimed in claim 24, further 
comprising the step of iowpass-filtering said input 
frames on a spatial domain prior to the step (b). 

26. A coding method for a video communica- 55 
tions system operating in a frame transmit mode or 

a frame discard mode depending on a rate of 
signals being transmitted, comprising the steps of: 



a) providing block matching between suc- 
cessive input frames with a smaller block size and 
producing a first motion vector during said frame 
transmit mode, and providing block matching be- 
tween successive input frames with a larger block 
size and producing a second motion vector during 
said frame discard mode; 

b) delaying said input frames for one frame 
period, providing motion compensation on the de- 
layed frame with said first motion vector and pro- 
ducing an interframe predicted error signal contain- 
ing an initial frame followed by a differential signal 
which is representative of a difference between 
each of said input frames and the motion-com- 
pensated frame during said frame transmit mode 
and is zero during said frame discard mode; and 

c) transmitting said pr> :icted error signal 
and said first and second motion vectors through a 
transmission medium. 

27. A method as claimed in claim 26. further 
comprising the step of Iowpass-filtering said input 
frames on a spatial domain prior to the step (b). 
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© Adaptive interframe prediction coded video communications system. 



© At the transmit end of a video communications 
system, a first motion vector is derived from succes- 
sive frames during a frame transmit mode and a 
second motion vector is derived during or imme- 
diately following a frame discard mode. An inter- 
frame predicted error signal is generated which is 
representative of the difference between each input 
frame and a motion-compensated, previous frame 
during the frame transmit mode, the difference being 
zero during the frame discard mode. The predicted 
error signal and the vectors are transmitted to the 
receive end of the system. In a first embodiment, the 
second motion vector is derived at the transmit end 
from frames spaced apart by a discarded frame, and 
at the receive end, original frames are recovered 

HC.l 



from the predicted error signal as well as from the 
first and second motion vectors, and the second 
motion vector is down-scaled and evaluated whether 
it is valid or not During frame discard mode, motion 
compensation is performed on the recovered frame 
using the down-scaled vector in response to a valid 
evaluation, but no compensation is performed if in- 
valid evaluation is made. In a second embodiment, 
the second motion vector is derived at the transmit 
end from successive frames using a larger block 
size than that used in the first motion vector. At the 
receive end. the first motion vector as well as the 
error signal are used in recovering original frames. 
During the frame discard mode, the second vector is 
simply used for motion compensation. 
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